I 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 7 
H04L 27/26, 25/03 



Al 



(11) International Publication Number: WO 00/54472 

(43) International Publication Date: 14 September 2000 (14.09.00) 



(21) International Application Number: PCT/USOO/06045 

(22) International Filing Date: 8 March 2000 (08.03.00) 



(30) Priority Data: 
60/123,348 
Not furnished 



8 March 1999 (08.03.99) US 
1 March 2000 (01.03.00) US 



(71) Applicant: BANDSPEED, INC. [US/US]; 6530 W. 6th Street, 

Los Angeles, CA 90048 (US). 

(72) Inventors: TONISSEN, Shane, Michael; 4 parsons Street, 

Kensington, VIC 3031 (AU). SKAFIDAS, Efstratios; 10 
Kelson Street, Coburg, VIC 3057 (AU). LOGOTHETIS, 
Andrew; 25 Riverview Tee, Bulleen, VIC 3105 (AU). 

(74) Agents: BECKER, Edward, A. et al.; McDermott, Will & 
Emery, 600 13th Street, N.W., Washington, DC 20005-3096 
(US). 



(81) Designated States: JP, European patent (AT, BE, CH, CY, DE, 
DK, ES, FI, FR, GB, GR, IE, IT, LU, MC, NL, PT, SE). 



Published 

With international search report. 



(54) Title: KALMAN EQUALIZATION IN MULTICARRIER RECEIVERS 
(57) Abstract 

A computer-implemented approach for reducing distortion 
in digital communications systems generally involves obtaining an 
optimal estimation of the original data using a Kalman filter with 
an increased length state to remove substantially all ISI in the 
time domain. The use of an increased length state in the Kalman 
filter provides a more accurate estimate of the transmitted data 
with relatively little additional computational cost. Subsequent 
equalization may also be performed in the frequency domain to correct 
any residual amplitude and phase distortion. 



500 

\ 



START 




502 



DETERMINE INITIAL STATE AND COVARIANCE 
ESTIMATES FOR KALMAN FILTER 



504 



DETERMINE STATE ESTIMATE 
AND COVARIANCE PREDICTION 



506 



CALCULATE INNOVATIONS COVARIANCE 



508 



CALCULATE KALMAN GAIN 



510 



CALCULATE UPDATED STATE ESTIMATE . 
AND COVARIANCE MATRIX 



CALCULATE DATA ESTIMATE FROM THE . 
INTERMEDIATE STATE ESTIMATE p \ 




512 



514 



END 



516 



0 



- j 





Codes used to identify 


AL 


Albania 


AM 


Armenia 


AT 


Austria 


AU 


Australia 


AZ 


Azerbaijan 


BA 


Bosnia and Herzegovina 


BB 


Barbados 


BE 


Belgium 


BF 


Burkina Faso 


BG 


Bulgaria 


BJ 


Benin 


BR 


Brazil 


BY 


Belarus 


CA 


Canada 


CF 


Central African Republic 


CG 


Congo 


CH 


Switzerland 


CI 


Cote d'lvoire 


CM 


Cameroon 


CN 


China 


CU 


Cuba 


CZ 


Czech Republic 


DE 


Germany 


DK 


Denmark 


EE 


Estonia 



FOR THE PURPOSES OF INFORMATION ONLY 
States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



ES 

FI 

FR 

GA 

GB 

GE 

GH 

GN 

GR 

HU 

IE 

IL 

IS 

IT 

JP 

KE 

KG 

KP 

KR 

KZ 

LC 

LI 

LK 

LR 



Spain 
Finland 
France 
Gabon 

United Kingdom 

Georgia 

Ghana 

Guinea 

Greece 

Hungary 

Ireland 

Israel 

Iceland 

Italy 

Japan 

Kenya 

Kyrgyzstan 

Democratic People's 

Republic of Korea 

Republic of Korea 

Kazakstan 

Saint Lucia 

Liechtenstein 

Sri Lanka 

Liberia 



LS Lesotho 

LT Lithuania 

LU Luxembourg 

LV Latvia 

MC Monaco 

MD Republic of Moldova 

MG Madagascar 

MK The former Yugoslav 

Republic of Macedonia 

ML Mali 

MN Mongolia 
MR Mauritania 
MVV* Malawi 
MX Mexico 
NE Niger 
NL Netherlands 
NO Norway 
NZ New Zealand 
PL Poland 
PT Portugal 
RO Romania 
RU Russian Federation 
SD Sudan 
SE Sweden 
SG Singapore 



SI 


Slovenia 


SK 


Slovakia 


SN 


Senegal 


sz 


Swaziland 


TD 


Chad 


TG 


Togo 


TJ 


Tajikistan 


TM 


Turkmenistan 


TR 


Turkey 


TT 


Trinidad and Tobago 


UA 


Ukraine 


UG 


Uganda 


US 


United States of America 


uz 


Uzbekistan 


VN 


Viet Nam 


YU 


Yugoslavia 


zw 


Zimbabwe 



WO 00/54472 



PCTAJSOO/06045 



KALMAN EQUALIZATION IN MULTI CARRIER RECEIVERS 



; RELATED APPLICATIONS 

This application is related to U.S. Provisional Application Number 

! 5 60/123,348, entitled "KALMAN FILTER BASED EQUALIZATION FOR HIGH 

SPEED DIGITAL COMMUNICATION CHANNELS," filed March, 8, 1 999 by 
SHANE MICHAEL TONISSEN, EFSTRATIOS SKAFIDAS and ANDREW 
LOGOTHETIS, the contents of which are incorporated herein by reference for all 
purposes. 

1 0 FIELD OF THE INVENTION 

The present invention relates to digital communications systems, and more 
specifically, to an approach for removing distortion in multi carrier digital 
communications systems such as Discrete Multi Tone (DMT) and Orthogonal 
Frequency Division Multiplexing (OFDM) systems. 

I 

1 5 BACKGROUND OF THE INVENTION 

One of the most important concerns in digital communications systems is 
minimizing distortion introduced by a communications channel, sometimes referred 
to as "channel effects." FIG. 1 is a block diagram 100 of a conventional digital 
communications system. Data is transmitted from a transmitter 102 to a receiver 104 

20 over a communications channel ("channel") 106. Channel 106 may be any type of 
communication medium for transferring data between transmitter 102 and receiver 
1 04. For example, channel 106 may be one or more network connections, wires, 
fiber-optic links or a wireless digital communications link. 

Ideally, data is transmitted between transmitter 102 and receiver 104 over 

25 channel 106 without being distorted. That is, the data retrieved by receiver 104 from 
channel 106 is identical to the data placed onto channel 106 by transmitter. 
However, in practice, channel 106 introduces distortion that can corrupt data 
transmitted over channel 106. The distortion introduced by channel 106 can cause 
successive transmitted symbols to interfere with each other, otherwise known as 

30 inter-symbol interference (ISI). ISI can cause severe corruption of digital data, 
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resulting in a very high bit error rate (BER). The corruption of data occurs while 
being transmitted across communications channel 106. In multi-carrier systems ISI 
must be removed before transformation of time domain data to frequency domain 
data, e.g., via a fast Fourier transform (FFT) } which causes ISI to be spread across all 
5 frequency bins, producing significant signal to noise degradation. The common 
solution to this problem is to remove ISI from the sampled data using time domain 
equalization (TDEQ) before transforming the sampled data from the time domain 
data to the frequency domain. This allows the original data to be recovered from the 
communications channel. 

1 0 FIG. 2 is a block diagram 200 illustrating an example implementation of 

transmitter 102 and receiver 104 of FIG. 1. Transmitter 102 typically includes an 
encoder 202, a digital-to-analog converter 204 and a transmit filter 206 and a line 
driver 207. Encoder 202 encodes the original digital data to generate encoded digital 
data. The encoded digital data is converted to analog encoded data by digital-to- 

15 analog converter 204. Transmit filter 206 removes unwanted components of the 

original data from the encoded analog data to generate filtered data. Line driver 207 
amplifies the signal to transmit the signal across channel 106. The filtered data is 
transmitted over channel 106 to receiver 104. 

Receiver 104 includes a differential amplifier 208, one or more receive filters 

20 209, an analog-to-digital converter 210 and an equalizer 212. After data is received 
by receiver 104 from channel 106, receive filter 209 removes unwanted components 
from the encoded analog data received from transmitter 102 over channel 106. 
Analog-to-digital converter 210 converts the encoded analog data received from 
transmitter 102 to encoded digital data. Equalizer 212 processes the encoded digital 

25 data to remove ISI. The encoded digital data is further processed by converting the 
data to the frequency domain via a Fast Fourier Transform to recover the modulated 
tones. Residual frequency domain equalization is performed in the frequency domain 
before the data is transferred to a decoder 214 that recovers the original digital data. 
Decoder 214 may be separate from receiver 104 as illustrated, or may be 

30 incorporated into receiver 104. 

Most conventional approaches for removing ISI have significant limitations 
that result in degraded performance. Many of the limitations in conventional 
approaches are attributable to the nature of ISI and the nature of other external noise 
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sources. Conventional approaches address each problem as independent, i.e., ISI 
removal and noise mitigation. Thus, solving one problem can exacerbate the effects 
of another. For example, some TDEQ mechanisms do not account for noise sources 
such as thermal noise and crosstalk. In addition, the characteristics (transfer 
5 function) of a communications channel are not necessarily static and can change over 
time. As a result, conventional TDEQ mechanisms suffer from a number of 
drawbacks generally including not removing all of the channel-induced ISI or having 
stability problems. For example, decision feedback TDEQ mechanisms can provide 
improved performance, but are difficult to apply to discrete multi-tone (DMT) 

10 transmission system applications, which limits their use. Furthermore, decision 

feedback TDEQ mechanisms can suffer from error propagation problems, wherein 
the occurrence of one error leads to an increased probability of the occurrence of an 
error in the subsequent data symbols. As another example, transmission preceding is 
also used to compensate for known channel effects. However, transmission 

15 preceding requires an accurate characterization of the channel and a cooperative 

transmitter. Furthermore, transmission precoding cannot be implemented in all types 
of transmission systems. For example, transmission precoding cannot be 
implemented within the current asynchronous digital subscriber line (ADSL) 
standards ANSI T1.413 and ITU992.2. 

20 Therefore, based on the need to reduce ISI in digital communications systems 

and the limitations in the prior approaches, an approach for reducing ISI in digital 
communications systems, and in particular DSL communications systems, that does 
not suffer from limitations inherent in conventional ISI removal approaches is highly 
desirable. 

25 SUMMARY OF THE INVENTION 

According to one aspect of the invention, a computer-implemented method is 
provided for processing data received from a communications channel. First, the 
data is received from the communications channel, wherein the transmitted data 
consists of data modulated onto an arbitrary number of carriers. Then, a minimum 

30 mean square estimate of the data before the data was transmitted on the 

communications channel is determined. Finally, the minimum mean square estimate 
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is used to compensate for the distortion introduced into the data by the 
communications channel and also the external noise sources. 

According to -another aspect of the invention, a computer-implemented 
method is provided for equalizing data received from a digital subscriber line, DMT 
5 or OFDM based communication system, to remove distortion in the data introduced 
by transmitting the data along a communications channel, e.g., a digital subscriber 
line. First, the data is received from the digital subscriber line. Then, a minimum 
mean square estimate of the data is determined using a Kalman filter. The minimum 
mean square estimate is used to compensate for the distortion in the data introduced . 
0 by transmitting the data on the digital subscriber line. 

"According to another aspect of the invention, a receiver is provided for 
equalizing analog data received from a communications channel, wherein the analog 
data includes distortion introduced by transmitting the analog data on the 
communications channel. The receiver comprises an analog front end (including 
5 filtering), an analog-to-digital converter and an equalizer. The analog-to-digital 

converter is configured to convert the analog data received from the communications 
channel to digital data. The equalizer is configured to determine a minimum mean 
square estimate of the analog data received from the communications channel and to 
use the minimum mean square estimate of the analog data to compensate for 
distortion introduced into the analog data by transmitting the analog data on the 
communications channel. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Embodiments of the invention are illustrated by way of example, and not by 
way of limitation, in the figures of the accompanying drawings and in which like 
reference numerals refer to similar elements and in which: 

FIG. 1 is a block diagram of a conventional digital communications system; 
FIG. 2 is a block diagram illustrating example implementations of the 
transmitter and receiver illustrated in FIG. 1; 

FIG. 3 is a block diagram of a communications system receiver implemented 
in accordance with an embodiment of the invention; 

FIG. 4 is a flow diagram illustrating an approach for removing distortion in a 
communications system according to an embodiment of the invention; 
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FIG. 5 is a flow diagram illustrating an approach for determining an optimal 
estimate of a single input sample of a data input sequence using a Kalman filter with 
an increased length state according to an embodiment of the invention; and 

FIG. 6 is a block diagram of a computer system upon which embodiments of 
5 the invention may be implemented. 

DETAILED DESCRIPTION OF THE INVENTION 

In the following description, for the purposes of explanation, specific details 
are set forth in order to provide a thorough understanding of the invention. However, 
it will be apparent that the invention may be practiced without these specific details. 
10 In other instances, well-known structures and devices are depicted in block diagram 
form in order to avoid unnecessarily obscuring the invention. 

Various aspects and features of example embodiments of the invention are 
described in more detail hereinafter in the following sections: (1) functional 
overview; (2) time domain equalization; (3) adaptive filtering; (4) frequency domain 
1 5 equalization; and (5) implementation mechanisms. 

1. FUNCTIONAL OVERVIEW 

A computer-implemented approach for reducing distortion in digital 
communications systems generally involves equalizing communications channel 
output data in the time domain to compensate for distortion introduced by the 

20 communication channel. According to one embodiment of the invention, a minimum 
mean square estimation of the original data is obtained using a Kalman filter to 
compensate for substantially all ISI in the time domain. The use of a Kalman filter 
with an increased length state provides a smoothing delay with relatively little 
additional computational cost. Subsequent equalization may also be performed in 

25 the frequency domain to correct residual amplitude and phase distortion. 

FIG. 3 is a block diagram that illustrates an example receiver 300 that 
processes analog encoded data received from communications channel 106 in 
accordance with an embodiment of the invention. Receiver 300 includes a receive 
filter 302, an analog-to-digital converter 304, a time domain equalizer 306, a time 

30 domain-to-frequency domain converter 308 and a frequency domain equalizer 310. 
The use of these components to process digital encoded data received from 
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communications channel 106 is now described with reference to a flow diagram 400 
of FIG. 4. 

After starting in step 402, in step 404, analog encoded data is received from 
channel 106. 

5 In step 406, the analog encoded data is filtered by receive filter 302 to remove 

any undesired components from the received analog encoded data. 

In step 408, the analog encoded data is converted to digital encoded data by 
analog-to-digital converter 304. 

In step 410, time domain equalization is performed on the digital encoded 
10 data by time domain equalizer 306 to remove substantially all ISL According to one 
embodiment of the invention, performing time domain equalization involves 
determining a minimum mean square estimate (MMSE) of the original data using a 
Kalman filter to compensate for ISI introduced by channel 106. However, although 
embodiments of the invention are disclosed herein in the context of determining the 
1 5 MMSE using a Kalman filter, any mechanism may be employed for this purpose and 
the invention is not limited to any particular mechanism. In general terms, minimum 
mean square estimation is defined by: 

E[(x-x) 2 \y] 

minx 
where : 

E is theexp ected value 

xis the original data transmitted in the communications channel 
x is the output of the equalizer mechanism 

\is the conditional meanon ytheoutputof the communications channel 

20 

Additional details and examples of the Kalman filter are described in more 
detail hereinafter. 

In step 412, the digital encoded data received from time domain equalizer 306 
is converted to the frequency domain by time domain-to-frequency domain converter 
25 308. Time domain-to-frequency domain converter 308 may incorporate any 
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techniques for converting the data, such as a fast Fourier transform, and the invention 
is not limited to a particular transformation technique. 

In step 414, frequency domain equalization is performed on the digital 
encoded data by frequency domain equalizer 3 1 0 to correct any residual amplitude 
5 and phase distortion, as described in more detail hereinafter. The process is complete 
in step 416. The data is then typically provided to a decoder to recover the original 
digital data. 

2 . TIME DOMAIN EQUALIZATION 

According to an embodiment of the invention, a Kalman filtering technique 
10 with an increased length state, i.e., a. smoother, is used to remove substantially all ISI 
from the received digital encoded data in the time domain by obtaining an MMSE of 
the original data. Kalman filtering, while never having been applied in nor 
considered for the context depicted in FIG. 3, is a well known technique for other 
uses in the field of mathematics. For example, see "Optimal Filtering" by B.D.O 
15 Anderson and J. Moore, Englewood Cliffs, N.J. Prentice Hall 1979 ISBN 

013631227. Referring to FIG. 2, data transmitted by transmitter 102 may be 
represented by a discrete time sequence x(k) that is processed by digital-to-analog 
converter 204 and transmit filter 206. The analog representation of the signal at the 
output of transmitter 102 is denoted by x(t). Channel 106 is characterized by its 
20 impulse response h(t). The output of channel 106, y(t), is then 

y(t)=h(t)*x(t) + n(t) (1) 

where x(t) is the channel input and n(t) accounts for all channel disturbances 
such as additive white Gaussian noise, crosstalk and echo noise. At receiver 104, the 
channel output y(k) is sampled to produce a discrete time received signal y(k). Thus, 
25 according to an embodiment of the invention, the goal is to obtain a discrete time 
estimate x(k) of the original discrete time signal x(k). 

It has been determined, in accordance with an embodiment of the invention, 
that the transmitted data sequence x(k) can be approximated by a white Gaussian 
sequence. This is due to the use of the inverse fast Fourier transform (IFFT) to 
30 generate the data samples and the fact that the symbols input to the IFFT are random 
in amplitude and phase and independent of each other. The approximate Gaussian 
nature of the data sequence is deduced from application of the central limit theorem. 
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Consequently, the white Gaussian assumption is best when the quadrature amplitude 
modulation (QAM) constellation size is large and the number of communications 
sub-channels is large. Any channel can be represented as an Auto Regressive 
Moving Average (ARMA) model by appropriate choice of the ARMA parameters to 
yield the actual channel impulse response. The channel output is well approximated 
by a white Gaussian input sequence driving an ARMA process, for which the 
Kalman filter yields the optimal estimate of the input sequence in the MMSE sense. 
The identified channel is represented by an ARMA model given by 

= ^ (2) 
a{z) K > 



10 



H(z) = 



bp+bjZ + b 2 z ...+b,„z 

* —1 —2 
1 + ajz +a 2 z +...+a m z~ 



(3) 



where ao = 1 by definition and H (z) has impulse response h (k), as an 
estimate of the sampled channel impulse response h(k). The channel identifier may 
1 5 use the equalizer output to estimate the channel response adaptively. 

Kalman filter based equalization is implemented as follows according to one 
embodiment of the invention. First, a state £(k) is defined to be a function of the data 
input and the denominator of the identified channel. Then the channel output is 
defined to be a function of the intermediate state §(k) and the numerator of the 
20 identified channel. These state and observation equations are given by: 



£(* + 1) = + Gx(*) 



(4) 



(5) 
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where A and B are derived from the identified channel parameters a(z) and 



b(2) 



A = 





-a 2 


-<5 3 
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and are given by: 

b=[z>o h --b m o-o] 



(7) 



It is assumed that a(z) and b (z) are of the same order m. If necessary, this 

can be achieved by padding the vector a or b with an appropriate number of zeros. 
In order to achieve a delay of "L M samples before the output is taken, the first row of 

A has "L+l" zeros after the a i elements. The remaining rows of A then consist of 
10 the "(L+m)x(L+m)" identify matrix and a column of zeros. Therefore, A is a 

"(L+rn+l)x(L+m+l) M square matrix. Similarly, the B matrix is extended with "L" 

zeros to form a "lx(L+m+l)" matrix. 

FIG. 5 is a flow diagram 500 illustrating an approach for determining an 

optimal estimate x (k) of a single input sample of the data input sequence x(k) using 
15 a Kalman filter with an increased length state according to an embodiment of the 

invention. The process is repeated for each successive input sample. After starting 

in step 502, in step 504, the initial state and covariance estimates for the Kalman 

filter are set to: 



£(0|0) = 



0 
0 



(8) 
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P(0|0) = 7 (9) 

To maintain consistency with the definitions of A and B , £ (. [ .) has 
dimension "(L+m*l)xV\ and P(. | .) has dimension "(L+m+l)x(L+m+l)". The 
initialization P(0|0) reflects the assumption that the input data is a zero mean unit 
variance white Gaussian sequence. If the input data is not a zero mean unit variance 
white Gaussian sequence, then the initialization is modified accordingly i.e g — g 
and P(0 1 0)= P Q .In step 506, the state estimate and covariance predictions are 
determined as follows: 



#(*|*-1) = ^(*-1|*-1) (10) 

P(k | k-l) = AP(k-l | k-l)A' + GQG' (11) 
where Q is the covariance of the data input x(k), which in this example is a 

scalar. 

In step 508, the innovations covariance is determined based upon the 
15 difference between the actual observation of the data and the data predicted from the 
state prediction. According to one embodiment of the invention, the innovations 
covariance is determined as follows: 

S(k)=BP(k\k-l)B' + R (12) 
In step 510, the Kalman gain is calculated as follows: 



10 



20 



K(k)=P(k\k-l)B'S(kr l (13) 
In step 512, the updated state estimate and covariance matrix are calculated as 



follows: 



£(* I *) = £(*! k-l) + K{k)(y(k)-Bg(k\ k-l)) (14) 
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P(k | k)-P{k | k-Y)-K{k)S{k)K{k)' (15) 

While this is the simplest form of the covariance update, it may suffer from 
5 numerical instability. In practice, a numerically stable form of the update is used 

i.e. P(k \k)=[l- K(k)B(k)]p(k j k - 1)[/ - K(k)B(k)} + K(k)R(k)K' (k) . For further 
details refer to "Stochastic Models, Estimation, and Control" P.S. Maybeck, 
Academic Press, Vol. 1, 1979. 

In step 514 the data estimate is calculated from the intermediate state estimate 
10 as follows: 

x(k-l\ k) = a£(k\k) (16) 
where 

£ = [0 0 1 a 1 a m ] (17) 

consists of a with "L" leading zeros to achieve the "L" sample delay to "smooth" the 
15 data. 

The process is complete in step 516. 

The data estimate x (k-L|k) is the MMSE estimate of the data input x(k-L) given 
received data up to time k and is the optimal estimate of the input data. If the 
channel characteristics do not change over time, then the filter gain and covariance 
20 converge to steady state values. In this situation, the Kalman filter becomes 
equivalent to a linear transverse filter. 

3 . ADAPTIVE FILTERING 

In some situations, the characteristics of the channel change over time. For 
example, changes in ambient conditions or channel configuration can cause the 
25 channel characteristics to change. Therefore, according to an embodiment of the 
invention, adaptive Kalman filtering is employed to account for changes in channel 
characteristics. Specifically, in situations where channel characteristics are changing 

-11- 
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over time, the updated channel parameter estimates denoted by A(k) and B (k) are 
used instead of the fixed matrices A and B . Furthermore, the Kalman filter yields 
the optimal gain K(k) that ensures the estimate x (k-L|k) is optimal. 

4. FREQUENCY DOMAIN EQUALIZATION 
5 In some situations, Kalman filter equalization may not provide exact 

equalization at all frequencies. Therefore, according to one embodiment of the 
invention, residual amplitude and phase distortion are corrected in the frequency 
domain. According to one embodiment of the invention, frequency domain 
equalization involves first determining the frequency response of the Kalman filter 
10 and then determining the required frequency domain equalization. Another 

embodiment would involve averaging a sequence of training data in the frequency 
domain to establish the gain dilation and phase rotation required for each QAM 
constellation in every tone and then applying this transformation to each 
constellation to the receive and transformed data transmission. 

1 5 a. Determining the Frequency Response of the Kalman Filter 

The first step in compensating for residual gain and distortion in the frequency 
domain is to determine the frequency response of the Kalman filter in the steady 
state. First, the steady state Kalman gain K ss is calculated, either by iteration or by 
solution of the Ricatti equation. Next, the transfer function of the Kalman filter 

10 equalizer in the z domain is calculated as follows: 

H eq (z) = a[(I-z- l )A + z- l K ss BAY K ss (l 8 ) 

Then the magnitude and phase of the frequency response at any desired frequency / 
is calculated by substituting z - e j27l/ in equation (18). The resultant complex valued 
transfer function is denoted H eq (/). 

-5 b. Determining Frequency Domain Equalization 

To determine the required frequency domain equalization, the overall transfer 
function from transmitted data sequence to time domain equalizer output is 
calculated by: 
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H total (z) = H(z)H eq (z) 



(19) 



Note that in situations where all ISI has been removed during time domain 
equalization, H to tai(/) is unity at all frequencies. The complex output of time domain 
to frequency domain converter 308 is denoted by X r (/). The frequency domain 
5 equalized output is then given by: 



Where H to tai(/) is obtained by substituting z=e i27t ^ in equation (19) at the discrete set 
of frequencies corresponding to the frequency bins of the mechanism employed in 
10 time domain to frequency domain converter 308. Xfdeq(/) represents the recovered 
QAM symbols that are then passed to decoder 214. 

5 . IMPLEMENTATION MECHANISMS 

The approach for removing distortion in communications systems is 
applicable to any type of communications systems and is particularly well suited for 

15 broadband digital communications systems including wireless systems, cable modem 
systems, DSL applications and in particular, ADSL applications. Furthermore, the 
approach may be implemented as part of a receiver or a communications system, or 
as a stand-alone equalizer mechanism. The invention may be implemented in 
hardware circuitry, in computer software, or a combination of hardware circuitry and 

20 computer software and is not limited to a particular hardware or software 
implementation. 

Figure 6 is a block diagram that illustrates a computer system 600 upon which 
an embodiment of the invention may be implemented at least in part in computer 
software. Computer system 600 includes a bus 602 or other mechanism for 
25 communicating information, and a processor 604 coupled with bus 602 for processing 
information. Computer system 600 also includes a main memory 606, such as a 
random access memory (RAM) or other dynamic storage device, coupled to bus 602 
for storing information and instructions to be executed by processor 604. Main 



x FDEQ(f) = 



(20) 



H total if) 
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memory 606 also may be used for storing temporary variables or other intermediate 
information during execution of instructions to be executed by processor 604. 
Computer system 600 further includes a read only memory (ROM) 608 or other static 
storage device coupled to bus 602 for storing static information and instructions for 
5 processor 604. A storage device 610, such as a magnetic disk or optical disk, is 
provided and coupled to bus 602 for storing information and instructions. 

Computer system 600 may be coupled via bus 602 to a display 612, such as a 
cathode ray tube (CRT), for displaying information to a computer user. An input 
device 614, including alphanumeric and other keys, is coupled to bus 602 for 

1 0 communicating information and command selections to processor 604. Another type 
of user input device is cursor control 616, such as^a mouse, a trackball, or cursor 
direction keys for communicating direction information and command selections to 
processor 604 and for controlling cursor movement on display 612. This input device 
typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis 

15 (e.g., y), that allows the device to specify positions in a plane. 

The invention is related to the use of computer system 600 for removing 
distortion in digital communications systems. According to one embodiment of the 
invention, the removal of distortion in digital communications systems is provided 
by computer system 600 in response to processor 604 executing one or more 

20 sequences of one or more instructions contained in main memory 606. Such 

instructions may be read into main memory 606 from another computer-readable 
medium, such as storage device 610. Execution of the sequences of instructions 
contained in main memory 606 causes processor 604 to perform the process steps 
described herein. One or more processors in a multi-processing arrangement may 

25 also be employed to execute the sequences of instructions contained in main memory 
606. In alternative embodiments, hard-wired circuitry may be used in place of or in 
combination with software instructions to implement the invention. Thus, 
embodiments of the invention are not limited to any specific combination of 
hardware circuitry and software. 

50 The term "computer-readable medium" as used herein refers to any medium 

that participates in providing instructions to processor 604 for execution. Such a 
medium may take many forms, including but not limited to, non-volatile media, 
volatile media, and transmission media. Non- volatile media includes, for example, 
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optical or magnetic disks, such as storage device 610. Volatile media includes 
dynamic memory, such as main memory 606. Transmission media includes coaxial 
cables, copper wire and fiber optics, including the wires that comprise bus 602. 
Transmission media can also take the form of acoustic or light waves, such as those 
5 generated during radio wave and infrared data communications. 

Common forms of computer-readable media include, for example, a floppy 
disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD- 
ROM, any other optical medium, punch cards, paper tape, any other physical 
medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, 

10 any other memory chip or cartridge, a carrier wave as described hereinafter, or any 
other medium from which a computer can read. 

Various forms of computer readable media may be involved in carrying one or 
more sequences of one or more instructions to processor 604 for execution. For 
example, the instructions may initially be carried on a magnetic disk of a remote 

1 5 computer. The remote computer can load the instructions into its dynamic memory 
and send the instructions over a telephone line using a modem. A modem local to 
computer system 600 can receive the data on the telephone line and use an infrared 
transmitter to convert the data to an infrared signal. An infrared detector coupled to 
bus 602 can receive the data carried in the infrared signal and place the data on bus 

20 602. Bus 602 carries the data to main memory 606, from which processor 604 

retrieves and executes the instructions. The instructions received by main memory 606 
may optionally be stored on storage device 610 either before or after execution by 
processor 604. 

Computer system 600 also includes a communications interface 618 coupled 
25 to bus 602. Communications interface 618 provides a two-way data communications 
coupling to a network link 620 that is connected to a local network 622. For 
example, communications interface 618 may be an integrated services digital 
network (ISDN) card or a modem to provide a data communications connection to a 
corresponding type of telephone line. As another example, communications 
30 interface 618 may be a local area network (LAN) card to provide a data 

communications connection to a compatible LAN. Wireless links may also be 
implemented. In any such implementation, communications interface 618 sends and 
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receives electrical, electromagnetic or optical signals that carry digital data streams 
representing various types of information. 

Network link 620 typically provides data communications through one or 
more networks to other data devices. For example, network link 620 may provide a 
5 connection through local network 622 to a host computer 624 or to data equipment 
operated by an Internet Service Provider (ISP) 626. ISP 626 in turn provides data 
communications services through the world wide packet data communications 
network now commonly referred to as the "Internet" 628. Local network 622 and 
Internet 628 both use electrical, electromagnetic or optical signals that carry digital 
1 0 data streams. The signals through the various networks and the signals on network 
link 620 and through communications interface 618, which carry the digital data to 
and from computer system 600, are exemplary forms of carrier waves transporting 
the information. 

Computer system 600 can send messages and receive data, including program 
1 5 code, through the network(s), network link 620 and communications interface 618. 
In the Internet example, a server 630 might transmit a requested code for an 
application program through Internet 628, ISP 626, local network 622 and 
communications interface 618. In accordance with the invention, one such 
downloaded application provides for the removal of distortion in digital 
20 communications systems as described herein. 

The received code may be executed by processor 604 as it is received, and/or 
stored in storage device 610, or other non-volatile storage for later execution. In this 
manner, computer system 600 may obtain application code in the form of a carrier 
wave. 

25 The novel approach described herein for reducing distortion in digital 

communications systems provides several advantages over prior approaches. A 
significant advantage is that elimination of substantially all ISI in the time domain 
allows data rates to approach the theoretical capacity of the communications channel, 
as defined by Shannon's theorem. Another advantage is that the approach can be 

30 implemented to operate on the received encoded data without requiring any changes 
to the transmission mechanism. The approach also provides inherent stability with 
no error propagation. Finally, the approach is applicable to DSL protocols and in 
particular, the ADSL and VDSL protocol. Thus the approach is compatible with 
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ADSL/VDSL, DMT and OFDM transmitters without requiring changes to the 
ADSL/VDSL, DMT and OFDM transmitters. 

In the foregoing specification, the invention has been described with 
reference to specific embodiments thereof. However, various modifications and 
5 changes may be made thereto without departing from the broader spirit and scope of 
the invention. The specification and drawings are, accordingly, to be regarded in an 
illustrative sense rather than a restrictive sense. 
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CLAIMS 

What is claimed is: 

1 1 . A method for processing data received from a communications channel, the 

2 method comprising the computer-implemented steps of: 

3 receiving the data from the communications channel, wherein the data is 

4 modulated onto an arbitrary number of carriers and includes distortion 

5 introduced by the communications channel; 

6 determining a minimum mean square estimate of the data before the data was 

7 transmitted on the communications channel; and 

8 using the minimum mean square estimate to compensate for the distortion 

9 - * introduced into the data by the communications channel. 

12. The method as recited in Claim 1 , wherein determining a minimum mean 

2 square estimate of the data before the data was transmitted on the 

3 communications channel includes processing the data using a Kalman filter. 



1 3. 
2 



1 4. 
2 



4 



The method as recited in Claim 2, wherein processing the data using a 
Kalman filter includes processing the data using a Kalman filter with an 



3 increased length state. 



The method as recited in Claim 1, further comprising after using the 
minimum mean square estimate to compensate for the distortion introduced 
3 by the communications channel, 

transforming the data from the time domain to a frequency domain to 

5 generate frequency domain data, and 

6 removing residual amplitude and phase distortion from the frequency domain 

7 data in the frequency domain. 

1 5. The method as recited in Claim 1, wherein: 

2 the communications channel is a digital subscriber line, 

3 the step of receiving the data from the communications channel includes 

4 receiving the data from the digital subscriber line, and 
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5 the step of determining a minimum mean square estimate of the data before 

6 the data was transmitted on the communications channel includes 

7 determining a minimum mean square estimate of the data before the 

8 data was transmitted on the digital subscriber line, and 

9 the step of using the minimum mean square estimate to compensate for the 

10 distortion introduced by the communications channel includes using 

1 1 the minimum mean square estimate to compensate for the distortion 

12 introduced by the digital subscriber line. 

1 6. The method as recited in Claim 1, wherein: 

2 the data is received from a Multicarrier communications system, 

3 the step of receiving the data from the communications channel includes 

4 receiving the data from a digital subscriber line, and 

5 the step of determining a minimum mean square estimate of the data before 

6 the data was transmitted on the communications channel includes 

7 determining a minimum mean square estimate of the data before the 

8 data was transmitted on the digital subscriber line, and 

9 the step of using the minimum mean square estimate to compensate for the 

10 distortion introduced by the communications channel includes using 

1 1 the minimum mean square estimate to compensate for the distortion 

12 introduced by the digital subscriber line. 

1 7. A method for equalizing data received from a digital subscriber line to 

2 remove distortion in the data introduced by transmitting the data on the 

3 digital subscriber line, the method comprising the computer-implemented 

4 steps of: 

5 receiving the data- from the digital subscriber line; 

6 determining a minimum mean square estimate of the data before the data was 

7 transmitted on the digital subscriber line using a Kalman filter; and 

8 using the minimum mean square estimate to compensate for the distortion in 

9 the data introduced by transmitting the data on the digital subscriber 
10 line. 
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1 8. The method as recited in Claim 6, wherein determining a minimum mean 

2 square estimate of the data before the data was transmitted on the digital 

3 subscriber line using a Kalman filter includes determining a minimum mean 

4 square estimate of the data before the data was transmitted on the digital 

5 subscriber line using a Kalman filter with an increased length state. 

1 9. The method as recited in Claim 7, wherein determining a minimum mean 

2 square estimate of the data before the data was transmitted on the digital 

3 subscriber line using a Kalman filter with an increased length state includes: 

4 determining initial state and covariance estimates for the Kalman filter, 

5 v - determining state estimate and covariance predictions, 

6 determining an innovations covariance, 

7 determining a Kalman gain for the Kalman filter, 

8 determining an updated state estimate and covariance matrix, and 

9 determining a data estimate based upon the updated state estimate. 

1 10. The method as recited in Claim 6, further comprising 

2 after using the minimum mean square estimate to compensate for the 

3 distortion in the data, transforming the data from the time domain to a 

4 frequency domain to generate frequency domain data, and 

5 removing residual amplitude and phase distortion from the frequency domain 

6 data in the frequency domain. 

1 11. The method as recited in Claim 9, wherein removing residual amplitude and 

2 phase distortion from the frequency domain data in the frequency domain 

3 includes averaging a sequence of training data in the frequency domain to 

4 establish a gain dilation and phase rotation required for each QAM 

5 constellation in every tone and then applying the transformation to each 

6 constellation in the received and transformed data transmission. 

1 ,12. The method as recited in Claim 9, wherein removing residual amplitude and 

2 phase distortion from the frequency domain data in the frequency domain 

3 includes 

4 determining a frequency response of the Kalman filter, and 
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5 determining a transfer function from the data before the data was transmitted 

6 on the digital subscriber line to the data received from the digital 

7 subscriber line. 

1 13. A receiver for equalizing analog data received from a communications 

2 channel, wherein the analog data includes distortion introduced by 

3 transmitting the data on the communications channel, the receiver 

4 comprising: 

5 one or more receive filters; 

6 one or more amplifiers; 

7 an analog-to-digital converter configured to convert the analog data received 

8 from the communications channel to digital data; and 

9 an equalizer configured to determine a minimum mean square estimate of the 

1 0 data received from the communications channel and to use the 

1 1 minimum mean square estimate to remove the distortion introduced 

12 by transmitting the analog data on the communications channel. 

1 14. The receiver recited in Claim 1 1, wherein the receiver further comprises a 

2 Kalman filter for determining the minimum mean square estimate of the data 

3 received from the communications channel. 

1 15. The receiver as recited in Claim 12, wherein the Kalman filter is a Kalman 

2 filter with an increased length state. 

1 16. The receiver as recited in Claim 1 1 , wherein the communications channel is a 

2 digital subscriber line and the analog-to-digital converter is configured to 

3 receive and convert the analog data from the digital subscriber line to digital 

4 data. 

1 17. A computer-readable medium for processing data received from a 

2 communications channel, the computer-readable medium carrying one or 

3 more sequences of one or more instructions which, when executed by one or 

4 more processors, cause the one or more processors to perform the steps of: 
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5 receiving the data from the communications channel, wherein the transmitted 

6 data is modulated onto an arbitrary number of carriers and includes 

7 distortion introduced by the communications channel; 

8 determining a minimum mean square estimate of the data before the data was 

9 transmitted on the communications channel; and 

10 using the minimum mean square estimate to compensate for the distortion 

1 1 introduced into the data by the communications channel. 

1 18. The computer-readable medium as recited in Claim 15, wherein determining 

2 a minimum mean square estimate of the data before the data was transmitted 

3 on the communications channel includes processing the data using a Kalman 

4 filter. 

1 19. The computer-readable medium as recited in Claim 16, wherein processing 

2 the data using a Kalman filter includes processing the data using a Kalman 

3 filter with an increased length state. 

1 20. The computer-readable medium as recited in Claim 15, further comprising 

2 instructions which, when executed by the one or more processors, cause the 

3 one or more processors to, after using the minimum mean square estimate to 

4 compensate for the distortion introduced by the communications channel, 

5 transform the data from the time domain to a frequency domain to generate 

6 frequency domain data, and 

7 remove residual amplitude and phase distortion from the frequency domain 

8 data in the frequency domain. 



The computer-readable medium as recited in Claim 15, wherein: 

the communications channel is a digital subscriber line, 

the step of receiving the data from the communications channel includes 

receiving the data from the digital subscriber line, and 
the step of determining a minimum mean square estimate of the data before 

the data was transmitted on the communications channel includes 



2 
3 
4 
5 
6 
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7 determining a minimum mean square estimate of the data before the 

8 data was transmitted on the digital subscriber line, and 

9 the step of using the minimum mean square estimate to compensate for the 

1 0 distortion introduced by the communications channel includes using 

1 1 the minimum mean square estimate to compensate for the distortion 

12 introduced by the digital subscriber line. 
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